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It is well known that protection against additive gaussian noise can be 
obtained in m-ary digital modulation systems by expanding bandwidth 
or by increasing the channel signal-to-noise ratio. It is also well known 
that arbitrarily small error probabilities can be attained in digital systems 
by using long and complex encoding and decoding procedures. Based on 
the results oj Shannon and Slepian, we derive jor an optimal system lower 
bounds to the channel signal-to-noise ratio for various probabilities oj error, 
jor various bandwidth expansions, and jor a processing interval not greater 
than the signaling interval oj the source. It is assumed that all m characters 
have equal a priori probabilities and that maximum likelihood detection 
is used in the receiver. For a bandwidth expansion oj two, and jor equal 
energy code words, we also show that the performance oj a coherent phase- 
shijt keyed system is as good as that of the optimal system. 

1. INTRODUCTION 

Various ?n-ary digital modulation schemes [such as coherent phase- 
shift keying (CPSK), differentially coherent phase-shift keying 
(DCPSK), frequency-shift keying (FSK), and others] are currently 
under investigation for use in satellite, terrestrial, and other radio 
communication systems. 1,2 ' 3 In such systems, the transmission channel 
is noisy, and bandlimited, and one is interested in finding an optimum 
form of modulation for the transmission of information from one point 
to another. By optimum form of modulation, we mean that we would 
like to transmit (with a given error rate) as much information as possible 
in a given band of frequencies and for a given amount of (channel) 
signal power. 

The complexity of the equipment required for particular kinds of 
modulation, or other considerations in the system, may rule out these 
optimum transmission schemes in favor of simple and suboptimum 
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schemes of modulation and demodulation. In order to compare the 
performance of these simpler practical modulation systems with that 
of the optimal systems, it is first essential to investigate the performance 
of these optimal systems. 

In this paper we shall assume that the noise in the channel available 
for communication is gaussian and has a uniform power spectral density 
over all useful frequency bands. [In terrestrial systems, in the frequency 
bands above 10 GHz, close spacings of the repeaters are almost always 
mandatory for reliable communication (during fading conditions pro- 
duced by rain). 2 If low noise receivers are used in the system, it is pos- 
sible that the total interference power (due to co-channel and adjacent 
channel interferers) received by the system may be very much larger 
than the (thermal) noise power in the system. 3 In this case, note that 
the total noise corrupting the channel may not be assumed gaussian 
in all modulation systems (especially if the number of interferers is 
small). 4,5 ] 

It is well known that protection against (additive) white gaussian 
noise can be obtained in m-ary digital modulation systems by expanding 
bandwidth and/or by increasing the channel signal-to-noise (power) 
ratio. In fact, Shannon has shown that it is possible to transmit with 
arbitrarily small error probability the output of a discrete source of 
entropy R over a channel of bandwidth W perturbed by additive white 
gaussian noise of average power N by using signals of average power 
S provided R is less than W log 2 (1 + S/N) b/s. 6,7 However, such a 
transmission scheme may involve long and complex encoding and 
decoding procedures, and to attain these low error rates it may be 
necessary to provide large storage (or long delay) in the transmitting 
and receiving equipment. Practical modulation systems presently used 
for large scale communication do not in general have such large storage 
capabilities or unlimited bandwidths. Also, we must note that there 
are practical limitations on the average power of a transmitter and the 
power that can be received by a receiver. 

Since most of the practical modulation systems have a certain band- 
width expansion n and since bandwidth expansion usually improves 
the (noise) performance of the system, we shall now investigate the 
optimum performance of digital modulation systems that have a (chan- 
nel) bandwidth expansion n, a finite channel signal-to-noise power 
ratio S/N = p 2 , and a processing interval which cannot exceed one 
signaling interval T of the source.* The message source is assumed to 



* It is assumed that the time interval over which the channel is used in decoding 
one message symbol cannot exceed T. 
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be of bandwidth W , and the channel bandwidth is assumed to be W. 
Further, it is assumed that all m characters (the output of the discrete 
message source consists of m different characters or symbols) have equal 
a priori probabilities and that the characters generated by the message 
source are statistically independent of each other. We also assume that 
a maximum likelihood detection scheme is used in the receiver. 

For such a system, we shall evaluate the lower bounds to the character 
error probability P(ni, n, p 2 ) of the optimal system so that we can com- 
pare its performance with that of any practical modulation system. 
For a given error rate, the difference between the signal-to-noise ratio 
required by the optimal system and that required by the practical system 
will then be a measure of the quality of performance of the practical 
modulation system. 

Here, we would like to note that our approach is identical to that of 
Slepian in Ref. 8 in which he evaluated upper and lower bounds to 
P(m, n, p 2 ) for n odd, n ^ 5, and m = 128 (numerical results for m = 
32, 64, and 256 can also be found in an unpublished memorandum by 
Slepian 9 ) when 1 ^ P(m, n, p 2 ) ^ 10~ 5 .* In addition to giving numerical 
results when P(m, n, p 2 ) < 10~ 5 (error rates as low as 10~ 9 are desired 
in some digital modulation systems 2 ) for m = 2, 4, 8, 16 and 32, we 
give a method of evaluating upper and lower bounds to P(m, n, p z ) 
for all values of n ^ 2. We also point out the special significance of 
n = 2, and give closed form solutions for the lower bound when n = 
2, 3 and 5. 

II. COMMUNICATION SYSTEM MODEL 

The m-ary digital modulation system that we shall consider in this 
paper is assumed to have a signaling interval T. Since we assume Nyquist 
rate signaling, we shall assume that 

where W is the bandwidth of the message source. Every T seconds, 
the message source generates one of m characters or symbols. Since the 
characters generated by the message source are assumed to be sta- 
tistically independent, the entropy R of the message source is given by 

R = 2W log 2 m b/s. (2) 



* Note that Slepian uses P(m, n, p 2 ) in determining the threshold in analog modu- 
lation systems that expand bandwidth. 

f Compare the communication system model that we discuss in this paper to 
that given in Ref. 8. 
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If S is the average power in the channel of bandwidth W, it follows 
from Ref. 6 that it is possible to transmit with arbitrarily small error 

probability if and only if 

2W o log 2 m^W log 2 (1 + S/N) (3) 

when there are no restrictions on the way in which the transmitter and 
receiver operate. 

Equation (3) can be shown to yield 

S/N ^ m 2/n - 1 (4) 

where 

W 
n = r==- = 2TW = the bandwidth expansion factor. (5) 

"0 

The lower bound to S/N given by equation (4) is then the smallest 
signal-to-noise ratio required to transmit (with arbitrarily small error 
probability) an m-ary digital signal through a channel of bandwidth 
expansion n when there are no restrictions on the transmitting and 
receiving equipments. This lower bound to the signal-to-noise ratio 
S/N is shown in Fig. 1. 

In the communication system model we are considering in this paper, 
there is no provision for the storage of a large number of characters, 
and hence it is to be expected that we will need signal-to-noise ratios 
much larger than those given in Fig. 1 (when arbitrarily low error rates 
are desired). Since the processing interval of our communication system 
is assumed not to exceed one Nyquist interval (corresponding to the 
message source), the channel signal corresponding to time T can be used 
to decode one and only one message symbol.* If the bandwidth of the 
channel is W, the channel signal can be completely specified by samples 
taken every 1/2W seconds. In the Nyquist interval T, there are then 
n = 2WT channel samples. 1. We are then assuming that n channel 
samples are used to decode one message character, or that each of the 
m message symbols are mapped into a channel vector having n com- 
ponents. 1 (In the error-free transmission scheme of Shannon, I, I ^ 1, 
successive message symbols are mapped into one channel vector. By 
making ( sufficiently large, by choosing the m l channel vectors appro- 
priately and by decoding appropriately at the receiver, the results given 



* This is equivalent to saying loosely that the communication system does not 
have storage capability for more than one Nyquist interval. 8 

+ There are certain subtle points involved in this assumption. Some of these points 
and their implications are discussed in Refs. 10 and 11. 

* That is, we construct a dictionary that associates with each of the m message 
symbols a particular n-dimensional channel vector. 
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Fig. 1 — Lower bound to the signal-to-noise ratio for different bandwidth expansions 
and ideal signaling. 

by Shannon may be obtained. It is to be noted that it is essential to 
store I message characters before we can generate the appropriate 
channel vector. In our scheme of transmission, we put I = 1, and in- 
vestigate the optimum performance of the system.) 

As far as the average power in the channel is concerned, the channel 
vectors can be chosen in a variety of ways. 12 Since all the characters 
are assumed to have equal a priori probabilities, we will make the 
assumption that all of them have the same average power S (or the 
same energy ST).* 

Since the noise corrupting the channel is assumed to be white, each 
component of each channel vector is perturbed independently by the 
addition of a gaussian variate of mean zero and variance N. 



III. EVALUATION OF PROBABILITY OF ERROR P(m, 71, (?) 

Since the channel vectors corresponding to different message symbols 
have the same average power S, all these n-dimensional vectors ter- 

* Other types of restrictions (such as maximum power, maximum average power, 
and so on) can also be put on the signal vectors to analyze the communication system 
given in our paper. Since all symbols are assumed to be equally likely, we do not 
consider a system in which there can be unequal distribution of power among different 
channel vectors. In particular, some amplitude modulation systems (such as single- 
sideband AM) do not satisfy the requirement that channel vectors corresponding 
to different message characters have the same average power S, and hence such 
systems are not covered in this paper. 
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minate on the surface of a sphere of radius (n*S)\ By choosing the chan- 
nel vectors appropriately, and by using maximum likelihood detection 
receiver, it can be shown 12 that the minimum probability of error 
P(m, n, p 2 ), averaged over all symbols, satisfies the inequalities 

o 

Q(m, n, p 2 ) ^ P(m, n, p 2 ) < Q(m, n, p 2 ) , p = -^ , (6) 

where 8 ' 12 



P„(X) = 



2-V)*r(^ 



(7) 



Q(m, n, p 2 ) = L\d m , n , n, p 2 -) , 

Q(m,n, p 2 ) = u(d m , n ,n, p 2 |) , (8) 

2 L s™ n ~ 2 » d » r ( n -i i 



m f^ 2 . _ ■ \ 2 2/ (9; 

/ sin" p rfp 

Jo 

l(«,», p 2 |) = I'pnQOdh, (10) 

ff(*, n, p 2 |) = l((9, n, P 2 f) + 0(0) £ p„(X)Q(X) dX, (11) 

/_ i\ (n-l)/2 r X 

T(k) = /"" e'V -1 dx, (13) 

(n — 1) exp ( — p 2 - sin 2 X J sin"" 2 X 



dr, (14) 



•fr-exp[- [r -^f C ° SX)S 

and I x (a, /3) is the incomplete beta function given by 

/.(«, /3) - 7^7^ f r ~ , ( 1 - O"" 1 <**, £ x £ 1; (15) 

■o(«, P) Jo 

B( a , p) = [ r _, (l - tY~ l dt. (16) 

Jo 
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The significance of the inequalities in equation (6) may be explained 
as follows. No ?/i-ary digital modulation system with a given bandwidth 
expansion n and a given signal-to-noise ratio p 2 can achieve a lower 
probability of error than that given by Q(m, n, p 2 ).* Also, we observe 
from equation (6) that m-ary digital modulation systems can be built 
to have an error probability given by Q(m, n, p 2 ). f 

The bounds given by equation (6) can, therefore, be used in com- 
paring the performance of practical modulation systems with that of 
the optimal systems, and in estimating the quality of performance of 
the practical modulation systems. For a given probability of error, and 
m and n, we can compare the signal-to-noise ratio required for a practical 
modulation system with the minimum signal-to-noise ratio predicted 
by equation (6) for the optimal system. 1 

Since we are interested in this kind of comparison and since there 
seem to be theoretical considerations which show 10 that Q{in, n, p 2 ) is a 
very weak bound [it is shown in Ref. 10 that some explicit codes can be 
constructed to make P{m, n, p 2 ) very close to Q(m, n, p 2 )], we shall not 
discuss the upper bound Q(m, n, p 2 ) any more in this paper. 

IV. EVALUATION OF LOWER BOUND Q(m, 71, p) 

For the sake of comparing the performance of proposed modulation 
systems with that of the optimal systems, it is essential to evaluate the 
lower bound Q(m, n, p 2 ) for different values of m and n. The evaluation 
of Q(m, n, p 2 ) is rather difficult and is usually done by using a digital 
computer. Slepian 8 has given methods of evaluating this bound when 
n is odd, and numerical values are given for Q(m, n, p 2 ) when 1 ^ 
Q(m, n, p 2 ) ^ 10" 5 , m = 32, 64, 128 and 256, and n ^ 5. 

Since error rates of less than 10~ s are desired in digital systems and 
since no numerical results are available when m < 32 (in general, it is 
easier to build digital modulation systems with low values of m), we 
shall give some further numerical values for the cases considered by 
Slepian. In addition, we shall give a method to evaluate Q(m, n, p 2 ) 
when n is even and point out its special significance when n = 2. 

First we review briefly Slepian's method of evaluating Q(m, n, p 2 ). 10 
For any given values of m and n, we evaluate by interpolation the value 
of m . n(0 < 9 m , n ^ 7r/2) from the set of tables for I x (a, 0) given in Ref. 

* Of course, we assume that the digital modulation system satisfies other require- 
ments given in this paper. 

t For re = 1 or 2, it can be shown that we can make Q(m. n, p 2 ) = P(m, n, p*). 
Also, for all (integral) n, and m = 2, we can make Q(2, n, p 2 ) = P(2, n, p 2 ). 

* In making this comparison, we have to assume that we can estimate the band- 
width expansion factor n for the practical modulation system. 
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13. Since it has been shown 10 that 
L(e,n,cr 2 ) = L(d,n- 2, a 2 ) + cos 6G(d,n- 2, a 2 ), n > 3, (17) 

S = P 2 1, ( 18 ) 

G(6, n, a- 2 ) = a cos 0sin 6b n G(d, n - I, a) 

+ ^^-^sin 2 6G(6,n -2, a 2 ), n> 2, (19) 

n — 1 

6„ = ±=4 *>-* - n > 2 < (20) 

n — 1 

and 

b, = *», (2D 

6 2 - 4 . < 22 ) 

£(0, i, , 2 ) = I exp (-<r 2 sin 2 9)[2 - erfc (a cos 5)], (23) 

(?(0, 2, cr 2 ) = -sin 5 exp (-a 2 ) + ^sin cos 6G(d, 1, <r 2 ), (24) 

IT T 

L(0, 3, «r 2 ) = h erfc (<r) + cos 6G(d, l,a 2 ), (25) 

where 

erfc (x) = 4 f exp (-/ 2 ) d* - 1 - erf (a), (26) 

7T J x 

Q{m, n, p 2 ) can be evaluated for odd n from equations (7), (9) and (17) 
through (25). However, for even n, we cannot use Slepian's method of 
evaluating Q(m, n, p 2 ) unless we can find an explicit expression for 

L(0,2,<r 2 ). 

Now it has been proved 14,1 that moderately high values of n(2 < 
n < 5) are required for some digital modulation systems in order to 
optimize transmission rates per unit bandwidth. Since we would like 
to compare these systems (and other systems with similar bandwidth 
expansions) with the optimal systems, we shall first express Q(m, n, p 2 ) 
explicitly for odd n, and n ^ 5 before we discuss the evaluation of 
Q(m, n, p 2 ) for even n. 

4.1 Lower Bound Q(m, n, p 2 ) for n = 3, 5 

For n = 3, equations (7), (9), (10), (13) and (14) can be shown to 
yield 
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Q(m, 3, p 2 ) = \ (erfc [p(f)»] + (1 - 2/m) 



•exp 



For m = 2', 1 ^ £ ^ 5, we have evaluated Q(m, 3, p 2 ) and have shown 
the results in Fig. 2. 

Let us now compare the performance of an FSK system (using square- 
wave modulation, ideal discrimination detection with an integrate- 
and-dump circuit as the post-detection filter) with a bandwidth expan- 
sion of 3 with the performance of the optimal system. For the FSK 
system the symbol error probability P FS k can be shown 16,17 to be given 
by 



P 



1 



FSK 



(W¥ 



cot {i^M.' 



i cos 



2 m 



f 



exp 



-2p 2 sinM; 



p 2 »l, n < m+ 1. (28) 



For n = 3 and ?n = 4 and 8 we have plotted Pfsk and Q(m, 3, p 2 ) in 
Fig. 3. Noting that the error rate of the optimal system can be made 
close to Q(m, n, p 2 ) for small n, it can be observed from Fig. 3 that the 
error performance of the FSK system is inferior to the optimal system 
by several decibels. However, note that the formula in equation (28) 
is an asymptotic formula and that we have calculated the bandwidth 
expansion factor for the FSK system by Carson's rule. Also, note that 
we have taken the bandwidth of the message source to be 1/2 T, where 
T is the signaling interval of the source. If all these assumptions are 
reasonable, we must conclude from Fig. 3 that the performance of the 
FSK system is far from being optimum. 

Let us now consider n = 5. For n = 5, we have 

Q(m, 5, p 2 ) 

1 T e r /5\4i i 5p Si n 2 B COS 2 6 . 25. 

= 2 j^erfc [p(f)*] + ^ exp { -p 2 } 

+ | cos 6 exp {-p 2 f sin 2 0}(sin 2 6 + 5p 2 cos 2 0sin 2 6 + 2) 



[2 - erfc [p(|)* cos $] 



(29) 
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Fig. 2 — Lower bound Q(m, n, p 2 ) for n = 3. 
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Fig. 3 — Comparison of the FSK system with the optimal system, n = 3. 
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where 



and 



cos = 2 cos 



4t . 1 , , _ 

T+3 C0S [ ~ 



■(!-)]• 



(30) 



sin 6 = +(1 - cos 2 6)K (31) 

For m = 2', 1 ^ £ = 5, we have plotted Q(m, 5, p 2 ) in Fig. 4. 

For n odd, and n > 5, derivation of an expression for Q(m, n, p 2 ) 
becomes rather tedious and long, and we shall not give these expressions. 
However, for n = 7, 9, 11, 13 and 17, we have calculated Q(m, n, p 2 ) 
for m = 2 l , 1 = t ^ 5, and the results are given in Figs. 5, 6, 7, 8 and 9. 
These numerical results which add to the results given by Slepian were 
obtained by using his method (see Appendix A for an alternative 
method). 
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Fig. 4 — Lower bound Q(m, n, p 2 ) for n = 5. 
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Fig. 5 — Lower bound Q(m, n, p 2 ) for n = 7. 

4.2 Lower Bound Q(m, n, p 2 ) for n even 

Since we can calculate Q(m, n, p 2 ) from L(6, n, <r 2 ) and since the re- 
currence equation relates L(0, n, a 2 ) to L{8, n — 2, <r 2 ) [see equation 
(17)], we can calculate Q(m, n, p 2 ) for even n if we can calculate L(d, 2, a- 2 ) . 

It can be shown that 



L(d, 2, <r 2 ) - f p 2 (X, <r 2 ) 

Jg 



d\ 



where 



1 r — 



p 2 (X, <r 2 ) = - [«"*" + o-(ir)* cos Xe~ ff ° 8iQ ° x (1 + erf (a cos X)}]. 



(32) 



(33) 



Noting that p 2 (X, ^ 2 )/2 is the probability density of the phase angle 
of a sinusoidal carrier of amplitude (2 A) corrupted by random gaussian 
noise of average power N (signal-to-noise ratio a 2 = A/N), we have 
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18 



Fig. 6 — Lower bound Q(m, n, p 2 ) for n = 9. 

shown in Appendix B that L(0, 2, a 2 ) can be calculated for any 9. Hence 
we can calculate Q(m, n, p 2 ) for any even n. Now it can be shown 4 
(see Appendix C) that* 

L(9, 2, a 2 ) = i erfc (<r), 9 = tt/2; (34) 

L(9, 2, a 2 ) = erfc [cr/(2)*] - } erfc 2 [<r/(2)*], 9 = tt/4 

and 



h erfc (a sin 9) + max SO, h erfc (o- sin 5) 

— exp (— <j 2 )fl — 7r*cr exp (o- 2 ) erfc (a)]> 

^ L(0, 2, <r 2 ) < erfc (ersin 9), < 9 ^ tt/2; (35) 



* Some of these results can be obtained from Ref. 4 by putting Q = 0. 
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Fig. 7 — Lower bound Q(m, n, p 2 ) for n = 11. 



where 



\a, a ^ 6; 



max [a, b] = T' w ^ "' (36) 

[b, a < b. 

Since the upper and lower bounds to L(0, 2, a 2 ) cannot differ by more 
than a factor of two and since all quantities involved in equations 
(17) through (25) are positive, we shall now write a modified bound 

Q'(m, n, p 2 ) = L'{d m , n , n, a 2 ) (37) 

where 

L'(d,n,a 2 ) =L'(d,n -2, a 2 ) + cos dG(d,n- 2, a 2 ), n > 3, (38) 
and 

L'(d, 2, a 2 ) = \ erfc (a sin 0). (39) 
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Since 
note that 



Fig. 8 — Lower bound Q(m, n, p 2 ) for n = 13. 



L(6, 2, a 2 ) ^ L'(d, 2, a 2 ), < 6 ^ tt/2 



Pirn, n, p 2 ) ^ Q'(m, n, p 2 ). 
Let us now consider the particular case n = 2. For n = 2, 



2_ 

m 



dn 

£o 

fx/2 

/ dn 

Jo 



2d„ 



(40) 
(41) 

(42) 



or 



m .> = 



m 



(43) 



1048 



THE BELL SYSTEM TECHNICAL JOURNAL, JULY-AUGUST 1970 




-6 -4 



-2 2 4 6 8 10 

SIGNAL-TO-NOISE RATIO IN DECIBELS 



Fig. 9 — Lower bound Q(m, n, p 2 ) for n = 17. 

Since m . 2 = v/m, and p 2 (X, a 2 ) is given by equation (33), it can be 
shown 18 ,19 ' 20 from equations (7) and (10) that Q{m, 2, p 2 ) is equal to 
the error probability obtained in m-ary coherent phase-shift keyed 
(CPSK) systems. Also, for n = 2, it can be shown 12 that 

P(m, 2, p 2 ) = Q(m, 2, p 2 ). (44) 

It, therefore, follows that the error rates obtained in m-ary coherent 
phase-shift keyed systems are identical to those obtained in any m-ary 
digital modulation system that has a bandwidth expansion of two.* 
Hence we conclude that the error rates of any digital modulation system 
with a bandwidth expansion of two cannot be lower than the error rates 
of CPSK systems for all m. 

Since the error rates of CPSK systems have been investigated in 

* CPSK systems can be shown M ■" to have approximately a bandwidth expansion 
of two. 
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detail, 18,19,20 we shall not give numerical values of Q(m, 2, p 2 ) in this 
paper. However, we would like to note that 18,19,20 

Q(2,2, P 2 ) = |erfc( P ), (45) 

Q(4, 2, p 2 ) = erfc [ P /(2)»] - £ erfc 2 [p/(2)»], (46) 

and 



| erfc (p sin ir/m) + rnax ^0, § erfc (p sin 7r/m) 

- ^f-^ exp (- P 2 )[l - x J P exp (p 2 ) erfc (p)]} 

^ Q(m, 2, p 2 ) < erfc (p sin ir/ro), m > 2. (47) 

For signal-to-noise ratios greater than 5 dB, it can be shown 4 that 

Q(m, 2, p 2 ) « erfc (p sin ir/m), m ^ 4, (48) 

and that the error in this approximation is less than 5 percent. 

For n > 2, Q(m, n, p 2 ) can be evaluated by using methods presented 
in Appendix B and using equations (17) through (25). However, this 
is usually difficult and tedious, and since Q(m, n, p 2 ) and Q'(m, n, p 2 ) 
can at most differ by a factor of two, we shall use the modified bound 
Q'(m, n, p 2 ). Observe that Q'(m, n, p 2 ) can easily be evaluated from 
equations (18) through (24), and (37) through (39).* 

For n — 4, 8, 12 and 16, and m = 2 l , 1 ^ I ^ 5, we have evaluated 
Q'(m, n, p 2 ) and the results are shown in Figs. 10, 11, 12 and 13. 

V. DISCUSSION AND CONCLUSIONS 

Based on the results of Shannon and Slepian, we have derived, for 
different probabilities of error, lower bounds to the channel signal-to- 
noise ratio required by optimal systems to transmit the output of an 
m-ary message source through a channel of bandwidth expansion n. 
We assume that the channel is perturbed by additive white gaussian 
noise, all channel signals have the same average power S, and that 
the processing interval for decoding one message symbol is not greater 
than one signaling interval. When this interval can be arbitrary and 
when the transmission rate is not greater than the channel capacity, 
it is well known that the probability of error can be made arbitrarily 



* For any n, note that 2 n = ir/2, and that Q(2, n, p 2 ) = Q'(2, n, p 2 ) = \ erfc 

1p(«/2)" ! 1. 
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Fig. 10 — Lower bound Q'(m, n, p 2 ) for n = 4. 



close to zero by using long and complex encoding and decoding 
procedures. 

For different practical modulation systems, we can then compare the 
signal-to-noise ratio required for different probabilities of error with 
the lower bound given in this paper for optimal systems. This will aid 
us in deciding about the optimality or nonoptimality of different sys- 
tems, and in evaluating the quality of performance of different modula- 
tion systems. 

By using Slepian's method, we evaluate this lower bound for odd n, 
and m = 2', 1 ^ t ^ 5. We also give a method of evaluating the lower 
bound for even n, and derive a simpler modified lower bound for n even, 
and n > 2. This modified lower bound has been evaluated for n even, 
and m = 2',U^5. 

For a bandwidth expansion of two, the performance of a coherent 
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Fig. 11 — Lower bound Q'(m, n, p 2 ) for n = 8. 

phase-shift keyed system has been shown to be as good as that of the 
optimal system. 

A particular FSK system with a bandwidth expansion of three has 
been compared to the optimal system, and it appears that its perform- 
ance is substantially inferior to that of the optimal system. 

APPENDIX A 

Evaluation oj Lower Bound Q(m, n, p 2 ) 

In this appendix, we shall give a second method to evaluate Q(m, n, p 2 ). 
It can easily be shown from equation (9) that 



,. n = - for all n, 



(49) 
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Fig. 12 — Lower bound Q'(m, n, p') for n = 12. 

and that 

P(2, n, p 2 ) = Q(2, n, p 2 ) = \ erfc [p(n/2)»]. 
Hence, we can write 

L \2 ' n 'V = * erfc (°)' 
Since 

L(9, n, a 7 ) = J p n (\) d\, 



or 



l{o, n, p 2 1) = J'' 2 p„(A) d\ + J" p n (X) dX, 



(50) 



(51) 



(52) 



(53) 
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l(b, n, p 2 1) = t(b, n, p 2 1) + ft erfc [ P (n/2)*] ( (54) 

T(Bt n , ^ = (n - i) oxp (-*■) r dr r' 2 ^ exp ( _ r2/2) 
2-Wr(^) Jo Jb 

• exp (r(r(2) J cos X) sin" -2 X d\ . (55) 

Expanding exp (r(r(2)* cos X) into a Taylor series and integrating term 
by term, we have 

r( , iB , # . fr.-i)«p(-A g taa: r p »... exp _ r . Ar 

-T/2 

• / cos' X sin" 2 X tfX, 
_ (n- l)exp(-<r 2 ) f, (2?^ Jl + n\ 

= ^±i) ~ < ! l 2 ; 

Equation (56) can be simplified to 

ne,n,a) - 2(?r)1 2. e] i\ 2 j/ C03 ,^ 2 , 2 



(57) 



Equations (54) and (57) yield 

L(d, n, a- 2 ) = \ erfc (a) + ^r^ exp (-o- 2 ) 

For to not too large and for large n, it can be shown that 

a = 2__ (59) 

is small. If 5 is small, we can prove that the series given in equation 
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Fig. 13 — Lower bound Q'(m, n, p 2 ) for n = 16. 

(58) converges rapidly and that we may alternatively calculate 
Q(m, n, p 2 ) from equations (7), (9) and (58). 

APPENDIX B 

Evaluation of Distribution Function L(d, 2, <r 2 ) 
Equations (10) and (14) can be shown to yield 

L(d, 2, <f) = 1 - f pGO dix, (60) 

J-9 



where 



p(X) = — [exp (— <t 2 ) + (7(71-)* cos X exp (— a sin X) 



1 + erf (a cos X) ) ] . 



(61) 
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Note 18-20 that p(X) is the probability density function of the phase 
angle X, ^ X < 2x, of the sum of a sinusoidal carrier (of unit amplitude) 
and gaussian noise [of average power l/(2<r 8 )]. 
We can also show 19 that 

L(6, 2, a 2 ) = 1 - - - £ ^ sin kd, (62) 

7T t -=i K 

where 

h 2(+1 = ^ exp (-a 2 /2)[I<(a 2 /2) + IU*/2)), 

/= 0,1,2,-.. (63) 
h 2l = - £ A 2n+1 5«_ (2n+1) , / = 1, 2, 3, • • • ; (64) 

T „--00 

A_ 2s _ 1 = A 28+1 = ^ exp (-a 2 /2) [I.(aV2) + /. + .(^/2)], 

s = 0,1,2,-..; (65) 
and 

B-^-x = B 2p+I = (-D^^XT ex P ("°- 2 /2) 

• [/ p (<7 2 /2) + / p+1 (a 2 /2)], p = 0, 1, 2, • • • . (66) 

I n (x) is the modified Bessel function of the first kind and of order n. 
Since all h k 's can be calculated using either a set of tables or a digital 
computer and since the series given in equation (62) converges, we can 
calculate L(d, 2, a 2 ) for all a and 0. 

APPENDIX C 

Evaluation of Upper and Lower Bounds 

From equations (10) and (14), and Appendix B, we observe that 
L(d, 2, a 2 ) is the probability that the phase angle X, ^ X < 2ir, of a 
sinusoidal carrier of zero initial phase and unit amplitude lies outside 
the range — 6 ^ X ^ 6 when it is corrupted by random white gaussian 
noise of average power l/2<r 2 . 

When = r/2, we can show 10 ' 20 that 

L(0, 2, <r 2 ) = \ erfc (<r), = ir/2. (67) 
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When 6 = 7r/4, we can also show 18,20 that 

L(6, 2, a 2 ) = erfc [o/(2)»] -f erfc 2 [«r/(2)*]. 



(68) 



When ^ 6 < ir/2, let the sinusoidal carrier be represented by 
phasor OS in Fig. 14. Let x u and x, represent the in-phase and quadrature 
components of white gaussian noise corrupting the sinusoidal carrier. 
The quantity L(0, 2, a 2 ) is, therefore, given by the probability that the 
terminus of the vector OT lies in areas marked 1, 2 and 3. 

We, therefore, have 4 

erfc (a sin 6) exp (— o- 2 )[l — ir*<r exp (a 2 ) erfc (a)] 

^ L(6, 2, a 2 ) < erfc (<rsin d). (69) 

Also, since L(0, 2, <r 2 ) is greater than the probability that the terminus 
of the vector OT lies in areas marked 1 and 2 (or 2 and 3), we can write 

L(6, 2, a 2 ) > % erfc (<r sin 0). (70) 

Combining equations (69) and (70), we get equation (35). 

QUADRATURE 
AXIS 




Fig. 14 — Derivation of bounds to L(0, 2, a 2 ). 
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